The Oracle Problem When Testing from MSCs

The Oracle Problem When Testing from MSCs

Message Sequence Charts (MSCs) form a popular language in which scenariobased specifications and models can be written. There has been significant interest in automating aspects of testing from MSCs. This paper concerns the Oracle Problem, in which we have an observation made in testing and wish to know whether this is consistent with the specification. We assume that there is an MSC specificat...

Testing from structured algebraic specifications : the oracle problem

Work in the area of specification-based testing has pointed out that testing can be effectively used to verify programs against formal specifications. The aim is to derive test information from formal specifications so that testing can be rigorously applied whenever full formal verification is not cost-effective. However, there are still several obstacles to be overcome in order to establish te...

The Noisy Oracle Problem

Overcoming the Multiple Testing Problem When Testing Randomness

In this paper we propose a new method for overcoming the problem of adjusting for the multiple testing problem in the context of testing random number generators. We suggest it is to be used in conjunction with an existing method. More generally, the method can be useful in other situations where the multiple testing issue is encountered and the tests involved are not independent of each other,...

When Can Finite Testing Ensure Infinite Trustworthiness?

In this paper we contribute to the general philosophical‎ ‎question as to whether empirical testing can ever prove a physical law.‎ ‎Problems that lead to this question arise under several contexts‎, ‎and the ‎matter has been addressed by the likes of Bayes and Laplace‎. ‎After pointing‎ ‎out that a Bayesian approach is the proper way to address this problem‎, ‎we‎ ‎show that the answ...